Quantum annealing with Jarzynski equality 
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We show a practical application of the Jarzynski equality in quantum computation. Its imple- 
mentation may open a way to solve combinatorial optimization problems, minimization of a real 
single-valued function, cost function, with many arguments. We consider to incorpolate the Jarzyn- 
ski equality into quantum annealing, which is one of the generic algorithms to solve the combinatorial 
optimization problem. The ordinary quantum annealing suffers from non-adiabatic transitions whose 
rate is characterized by the minimum energy gap A of the quantum system under consideration. 
The quantum sweep speed is therefore restricted to be extremely slow for the achievement to obtain 
a solution without relevant errors. However, in our strategy shown in the present study, we find 
that such a difficulty would not matter. 



Quantum computer is believed to be able to solve in- 
tractable problems on classical computer by use of super- 
position, tunneling effect and entanglement attributed to 
quantum nature. This fascinating device is attracted to 
researchers and studied from both aspects of the fun- 
damental interests of quantum nature and its applica- 
tion. The intractable problems we wish to solve are 
often closely related to efficiency for cost and time in 
industry and distribution systems to gain convenience 
in our daily life. The efforts in both of the theoretical 
and experimental approaches have culminated to realize 
quantum computer, which can mitigate the difficulties 
to solve such hard problems. Hundreds of hard problems 
are found in optimization problem, which is a kind of the 
problems to minimize or maximize a real single-valued 
function of multivariables called the cost function. The 
cases in which variables take discrete values are known as 
combinatorial optimization, whose well-known instances 
are satisfiability problems, exact cover, maximum cut, 
Hamilton graph, and traveling salesman problem [l|, |2| . 
Most of the interesting optimization problems belong to 
the hard class in which the best known algorithms cost 
exponentially long time as a function of the system size 
(the number of degrees of freedom representing the cost 
function). Therefore one desires quantum computation, 
which enables us to solve such hard optimization prob- 
lems by an algorithm employing quantum nature. One 
of the generic algorithms proposed as part of such efforts 
is quantum annealing (QA) [3|45|- In QA, we introduce 
artificial degrees of freedom of quantum nature, noncom- 
mutative operators, which induce quantum fluctuations 
to drive the system as 



1^(0)) — £{o-| I ')/ » N, where N characterizes the sys- 
tem size of the optimization problem. The adiabatic the- 
orem guarantees that we can reach a nontrivial ground 
state of Hq after quantum dynamics with sufficiently slow 
speed as l/r c ~ A^ in , where r means the annealing 
time, and A is the energy gap of the instantaneous quan- 
tum system as in Eq. ([TJ [5, 6]. However QA does not 
work well in a reasonable time, since we require extremely 
slow control, for the cases in which the quantum sys- 
tem as in Eq. ([1} has a minimum energy gap vanishing 
as A m i n . ~ exp(— aN) for increasing the system size N 
7, 8] . The quantum annealing is a very generic technique 
but has such a bottleneck. 

To overcome the above difficulty, we bring another the- 
oretical piece from non-equilibrium statistical physics, 
the Jarzynski equality (JE), in the present study [9. Ildj. 
The Jarzynski equality is written by an well-known ex- 
pression as, 
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H(t) = f(t)H + {l-f(t)}H 1 , 



(1) 



where Hq is the classical Hamiltonian consisting of di- 
agonal elements, which express the cost function. Here 
fit) is assumed to be a monotonically increasing func- 
tion satisfying /(0) = and /(r) = 1. The quantum 
annealing starts from a single pure state, the ground 
state of H\, which is chosen to be trivially given as 



where the angular brackets denote the average over all 
realizations in a predetermined process starting from an 
initial equilibrium state and W is the work done during 
the process. The partition functions for the initial and 
final Hamiltonians are written as Zq{j3) and Z T (/3) with 
inverse temperature /3, respectively. We here recall the 
formulation of JE for classical systems on a heat bath 
[lOJ . Let us consider a thermal nonequilibrium process 
in a finite-time schedule < t < t. Thermal fluctuations 
can be simulated by the master equation. We employ 
discrete time expressions and write tk+i — tfc = St, to = 
and t n — t. The probability that the system is in a state 
<7fc at time t). is denoted as P(<7/-;ifc). The transition 
probability per unit time 5t is defined as Af(<jfc_|_i|<7/.; t k ). 
In the original formulation of JE, the work is defined as 
the energy difference merely attributed to the change of 
the Hamiltonian, but we can construct JE also in the case 
of changing the inverse temperature by defining the work 
as -/3W(a k ; t k ) = -(j3(t k+1 ) - (3(t k ))E(a k ), where E(a) 



is the value of the cost function (classical Hamiltonian 
Ho) for the specific state a. The left-hand side of JE can 
be expressed as 



{<J k }k=0 

xP(a ;t ), 



Q -j8W(o-fc + i;tfc) e $tM(a h+1 \a k ;t k ) 



(3) 



where P(ao]to) denotes the initial equilibrium distribu- 
tion. The initial condition is set to the equilibrium dis- 
tribution. If the transition term exp(6tM(ak+i\(Tk',tk)) 
is removed in Eq. ((3]), JE is trivially satisfied be- 
cause the summation of — f3W((Tk+i',tk) over k yields 
— (f3(t n ) — /3 (to)) E '((To). A non-trivial aspect of JE is in 
the insertion of the transition term, which does not al- 
ter the conclusion. From Eq. (j3|), it is straightforward 
to prove JE. This is the case for classical systems on a 
heat bath, not for quantum systems. One may think the 
above classical equality is not available for the applica- 
tion to QA. Nevertheless we can apply the classical JE 
to Q A by aid of the classical-quantum mapping [11] . 

The classical-quantum mapping leads us to a special 
quantum system, in which the (instantaneous) equilib- 
rium state of the above stochastic dynamics can be ex- 
pressed as a ground state. A general form of such a spe- 
cial quantum Hamiltonian is 



H q (a'\a;t) 



„ a -e^ H °^/ 2 M(a'\a;t)e-^ H '^y 2 . 

(4) 
This Hamiltonian has the ground state as |^ e q(i)) = 

E<7 e_£ ^' Ho(ff) k)/V^(*)' lt is clear that the quantum 
expectation value of a physical quantity A(cr) by |^ eq (i)) 
is equal to the thermal expectation value for the same 
quantity. The ground state energy is 0, which can be 
explicitly shown by the detailed-balance condition. On 
the other hand, the excited states have positive-definite 
eigenvalues, which can be confirmed by the Perron- 
Frobenius theorem. 

In the above special quantum system, we can treat 
a quasi-equilibrium stochastic process as an adiabatic 
quantum-mechanical dynamics in QA. Let us consider 
QA for the above special quantum system by setting the 
parameter corresponding to the temperature T — > oo 
(/3 — » 0). This condition gives the trivial ground state 
with uniform linear combination, similarly to the ordi- 
nary QA. If we tune T — > very slowly, one can obtain 
the ground state for H q , which expresses the very low- 
temperature equilibrium state for Ho, the cost function 
of the optimization problem that we wish solve. Notice 
that we use a single quantum state during the above pro- 
cedure, not an ensemble assumed in the ordinary formu- 
lation in JE. 

Let us construct a protocol with the same spirit as 
JE by using the special quantum system. Initially we 
prepare the trivial ground state with the uniform lin- 
ear combination as in the ordinary QA. From the point 



of view of the classical-quantum mapping, this initial 
state expresses the high-temperature equilibrium state 

|*eq(*0)) OC e -P(to)H (a)/2^ with fi^ ^ ]__ We in _ 

troduce the exponentiated work operator W((ik',tk) — 
exp(— (P(tk+i) — (3(tk))H ((Tk)/2). It looks like a non- 
unitary operator, but we can construct this operation by 
considering an extended quantum system as discussed 
later. If we apply W(ak',tk) to the quantum wave func- 
tion \^ cq (t k )), the state is changed into a state corre- 
sponding to the equilibrium distribution with the inverse 
temperature )3(tk+i). When the time-evolution opera- 
tor U(a'\a;tk+i) — exp(—iStH q (a'\a;tk+i)/h) is applied, 
this state does not change, since it is the ground state of 
H q (cr'\a; ifc+i). The obtained state after the repetition of 
the above procedure is 



I*(*r0) cx Y[{W(a k+1 ;t k )U k+1 ((T k+1 \(T k ]t k )}\y cq (to)). 

(5) 
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This is essentially of the same form as Eq. ((HJ) . Instead 
of the exponentiated matrix of 5tM(a k+ i \<r k ]t k ), we use 
the time-evolution operator U(o k +i\a k ;t k ) here. After 
the system reaches the state \ty(t n )), we measure the 
obtained state by the projection onto a specified state 
a'. The probability is then given by |(cr'| <!/(£„)) | 2 , which 
means that the ground state we wish to find is obtained 
with the probability proportional to exp(— /3(t n )Ho), 
since \ty(t n )) oc \^ C q(t n )). If we carry out the above 
procedure up to f3(t n ) 3> 1, we can efficiently obtain the 
ground state of Hq. This is called the quantum Jarzynski 
annealing (QJA) in the present paper. 

It may seem to be unnecessary to apply the time- 
evolution operator U(a k +i\a k ',t k ), which expresses the 
change between states by quantum fluctuations, at the 
middle step between the operations of the exponentiated 
work operators W(a k +i]t k ). The time-evolution oper- 
ator does not mean an artificial control but describes 
the change by quantum nature during quantum compu- 
tation. Let us remember the nontrivial point of JE. Even 
if we allow transitions between the exponentiated work, 
JE holds as in Eq. ©. 

We emphasize the following three points. First, the 
scheme of QJA does not rely on the quantum adiabatic 
control. The computational time does not depend on 
the energy gap. Therefore QJA does not suffer from 
the energy-gap closure differently from the ordinary QA. 
It is thus important to estimate the required compu- 
tational cost from the number of the unitary gates for 
the implementation of QJA as will be discussed below. 
Second, from a point of JE, the result is independent 
of the schedule to tune the parameter, r, in the above 
manipulations. Third, we do not need the repetition 
of the pre-determined process to deal with all fluctua- 
tions in the nonequilibrium-process average as in the or- 
dinary JE, since the classical ensemble is mapped to the 



quantum wave function. We operate the above proce- 
dure to a single quantum system in principal. Notice 
that, since we need a kind of practical techniques to real- 
ize QJA, several-time repetitions of experiments should 
be demanded since the result by quantum measurement 
should be probabilistic. However we should emphasize 
that this point is not related with the theoretical property 
of JE attributed to rare events, necessity of all the real- 
izations during the nonequilibrium process, but it comes 
from quantum nature. 

According to the property of JE, we can expect 
that QJA finds the ground state following the Gibbs- 
Boltzmann factor independently of annealing schedules. 
In contrast, without the multiplication of the exponen- 
tiated work, slow quantum control is necessary to effi- 
ciently find the ground state according to the ordinary 
QA. Let us take a simple instance to search the min- 
imum from a one-dimensional random potential, which 
is formulated as the Hamiltonian H — — J2i=i ^l*)(*l- 
Here Vi denotes the potential energy at site i and chosen 
randomly. By the linear schedule for tuning the param- 
eter /? from to 100, we apply QA without exponen- 
tiated work operations and QJA to the above system. 
Figure Q] shows the comparison between the probability 
for finding the ground state with N — 50 sites by QA 
and QJA with different schedules r = 1, 10 and 100. 
The plots for QJA (upper curves) are fixed along the 
reference curves (dashed curves) representing the instan- 
taneous Gibbs-Boltzmann factor. In other words, QJA 
does not depend on r, which characterizes the schedule 
of quantum computation. In contrast, QA (lower curves) 
needs sufficiently slow decrease of quantum fluctuations 
to efficiently find the ground state. 

To perform QJA, we need to implement the expo- 
nentiated work operation W(ak',tk) — exp(— (/3(tk+i) — 
/3(tk))Ho((Tk)/2), which looks like a non-unitary opera- 
tor. To implement this operation, we consider a quantum 
state with an ancilla qubit (another two-level quantum 
system) as l*^) = \^f) <8> \4>i), where 4>\ is assumed to 
take and 1 [12J. Initially we set | M/ , <?^x = 0), which is 
called the computational state below. It is convenient to 
assume the case that H$(<j) > for any states. Let us 
define the following "unitary" operator for the enlarged 
quantum system as 
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(6) 



where y(a) — ex-p(—5(3H (cr)). We can obtain the 
weighted quantum system by applying this operator to 
the computational state as yjy(a)\^ , (f>i =0). In that 
sense, we can regard IFunit. as the exponentiated work 
operation W(ak] ife) for the quantum state |^, <fri = 0) as 
above shown for the case in which we increase j3 mono- 
tonically. We can explicitly evaluate each probability am- 
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FIG. 1: (color online) Quantum Jarzynski annealing and 
quantum annealing for the one-dimensional random-potential 
problem. The probabilities for obtaining the ground state 
by both of the methods are plotted for r = 1, 10, and 100 
from top to bottom. The dashed curves denote the instanta- 
neous Gibbs-Boltzmann factor for reference. The upper solid 
curves (blue curves) representing the results by QJA are fixed 
to these reference curves, while the lower ones (red ones) ex- 
press the time-dpendent results by the ordinary QA. 



plitude of VFunit.l*, 4>i = 0) as 



(*,o|ww|*,o) = VyR 

(*,l|W unit .|#,0) = y/l-y{a) 



(7) 
(8) 



When we consider measurements of the quantum state, 
yj\ — y(cr)\^,<j)i = 1) is regarded as an undesired error 
state in our computation. We have to bound the error 
probability p e rror = 1 — J/( cr )- To decrease the error prob- 
ability and to avoid negative numbers in the square root, 
we here demand p e rror ~ 5/3max CT iJ(cr) -c 1. 

In QJA, to gain the relevant weight for the ground 
state of Ho, we have to increase a parameter correspond- 



ing to the inverse temperature up to (3(t n )e ~ 1, where 
e is the minimum energy gap of the "classical" Hamilto- 
nian H (usually given by the energy unit). Therefore 
the step of QJA, which corresponds to the step num- 
ber of the work operation W^nit.j is necessary up to n = 
/3(t n )/5/3 ~ l/eS/3. As a result, the computational time 
(the step number of the exponentiated work operation) 
should become longer asn~ l/ed/3 = max cr i?o(c r )/ePerror 
to make the error probability p e rror lower in our strategy. 
However the computational time for QJA does not de- 
pend on the detailed structure of the cost function. 

Since 5(3 is bound, we have to prepare an enlarged 
quantum state with n ancilla qubits as |\1/,</>i, ■ ■ ■ ,<p n ) 
to obtain the quantum state with the relevant weight 
after n-step exponentiated work operation as detailed 
below. The computational state of QJA in this case 
is |*,0, •••,0). The other states as |*, 1,0 • • • ,0), 
\ty, 0, 1, • • • , 0), etc. such that several ancilla qubits are 
flipped as (f>i — 1 are regarded as the error states sim- 
ilarly to the above simple case. To gain the weight 
up to exp(— j3(t n )Ho), we consider the n-step expo- 
nentiated work operations as I„ ® Y\ ® 1% ® • • • ® I n , 
I <T ®Ii®Y 2 ®I 3 ®- ~®I n , ■■■ andI CT ®Ji®---®I„_i®y n , 
where Ij denotes the identity matrix. We then ob- 
tain the desired state |\1/, 0, • ■ • ,0) after measurements 
with the weight as exp(— (3(t n )H ) — (1 — p CIIO r) n - The 
weights for the other states, the error states, are given 

as Porror(l - Porror)™" 1 for |^, 1, 0, • • • ,0) and pl„ OI (l ~ 

Pcrror) n ~ 2 for |^, 1, 1,0, • • • ,0) and so on. Therefore we 
can obtain the desired state by repetition of the experi- 
ments when we consider the realistic implementation of 
QJA in quantum computation. The demanded number 
of the repetition of the same experiments is evaluated 
as 1/(1 — terror)™ ~ 1 + max o .7f (c r )/e, which does not 
depend on the choice of p error . 

We here summarize the results of the above estima- 
tions. We tune the value of jWor "C 1 (for instance, 
Pcrror = 0.01) in order to efficiently yield the desired 
quantum state as exp(— f3(t n )H )\^,0, ■ ■ ■ ,0). Simulta- 
neously the computational time for QJA is determined 
as n ~ max a Ho(<j) / eperror (in the case p e rror = 0.01, 
n ~ 100max .i?o(c)/e)- Also the number of the rep- 
etition of the same experiments can be estimated as 
~ 1 + max ff ffo((r)/e. Even if the maximum value of the 
cost function becomes larger by increase of the system 
size as max cr iJ(cr)/e = N r where r is an arbitrary posi- 
tive value, both of the computational time and the num- 
ber of the ancilla qubits do not diverge exponentially, 
since n ~ N r /p cl - TOI . The repetition of the experiments 
can also be reduced to a moderate value as ~ 1 + N r . 

We consider an application of JE to quantum computa- 
tion as QA to solve the optimization problems by using 
the classical-quantum mapping. The classical-quantum 
mapping enables us to imitate pseudo-thermal processes 



in quantum computation. As we expected, this proto- 
col keeps the quantum system to express the equilib- 
rium state for the instantaneous inverse temperature. To 
decrease some errors occurring after the exponentiated 
work operation and measurements, we can not increase 
rapidly the inverse temperature to obtain the ground 
state and we need additional qubits. Nevertheless the 
cost for the realization of QJA in quantum computation 
does not diverge exponentially, which is the essentially 
different point from the ordinary QA and other quantum 
algorithms. The key point of QJA is that we need an- 
other resource like a "memory" in quantum computation 
instead of cut "time" . Fortunately, the amount of neces- 
sary memory (ancilla qubits) as well as the computational 
time for implementation of QJA does not diverge expo- 
nentially by the increase of the system size N. Thus the 
results by QJA shown here imply that we may overcome 
the difficulties in hard optimization problems and solve 
them in a reasonable time. The present results are pre- 
liminary but we should clarify the efficiency for several 
interesting hard problems we wish to solve in the future 
study [13[ . We hope that QJA becomes one of the basic 
algorithms using the quantum nature. 
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